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1.  Introduction 

For  the  past  several  years  Nortronics  has  supported  an  active  internal 
research  program  in  the  area  of  self-organizing  machines.  As  a part  of 
this  program, various  applications  to  automatic  pattern  recognition  have  been 
examined,  including  machine  classification  of  sonar  signals. 

The  importance  of  improving  classification  capability  for  deterrent/defen- 
sive naval  forces  has  been  recognized  for  some  time.  The  development  trend 
of  sonar  equipment  has  created  a situation  where  the  advantages  of  improved 
equipment  performance  (increased  range  and  sensitivity,  for  example)  has 
placed  a corresponding  burden  upon  the  sonar  operator's  classification 
ability.  Traditionally,  the  sonar  classification  task,  regardless  of  the 
type  of  equipment;  passive,  active,  processing,  or  display,  always  reverts 
to  use  of  the  human  brain  or  a group  of  brains  for  final  processing  and 
classification.  Therefore,  substantial  improvement  in  classification  capa- 
bility and  speed  can  be  expected  where  emphasis  is  placed  upon  those  techniques 
which  relieve  the  burden  of  classification  on  the  human  operator.^However, 
the  solution  to  this  specific  problem  is  one  which  should  be  approached  from 
a broader  context  - that  is,  the  solution  of  classification  problem*  in 
general.  It  is  this  view  which  forms  the  underlying  philosophy  forXNortronics' 
research  in  the  field  of  self -organizing  machines. 

Stated  briefly,  the  broad  objective  of  our  research  in  self-organizing  machines 
is  to: 

1.  Provide  novel  and  unique  techniques  which  will  permit  machines  to 
independently  acquire  the  ability  to  perform  a broad  spectrum  of 
information  processing  tasks. 

2.  Provide  techniques  which  will  qualitative ly  process  data  as  humans 
do  - but  without  the  inherent  human  quantitative  restrictions. 

Achieving  these  objectives  will  provide  for  a machine  which  can  accept  raw 
data  (for  example,  sonar  audio)  and  categorize  such  data  as  to  type  and 
location  of  targets  in  a manner  essentially  duplicating  human  performance. 

To  illustrate  these  points  and  the  intrinsic  problem  more  precisely,  con- 
sider the  operational  requirements  for  automatic  detection,  localization, 
and  classification. 
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2.  The  General  Problem 

The  classification  task  faced  by  the  Navy  is  not  unique,  but  is  one  which 
is  common  to  many  operational  military  systems.  The  requirement  for  auto- 
matic detection,  localization,  and  classification,  though  perhaps  in  differ- 
ent terminology,  appears  in  such  systems  as: 

. Radar  Decoy /Target  Identification 
. Photo  Inerpretation 
. Target  Location 
. Sonar  Classification 
. Speech  Processing 
. Seismic  Detection. 

Bach  of  these  tasks  appears  superficially  to  be  a different  problem,  because 
the  classification  rules  differ  from  one  task  to  another  and  because  the 
input  signals  and  peripheral  (sensor)  equipments  differ  — ranging  from 
mechanical  to  acoustical  to  nuclear  (see  Figure  1) . Yet,  it  is  evident 
that  all  these  tasks  have  a common  element  in  that  each  requires  associating 
a set  of  events  with  a set  of  categories.  Furthermore,  one  can  observe 
that  the  human  brain,  which  may  be  regarded  as  a standard  mechanism,  can 
acquire  the  ability  to  classify;  i.e.,  it  can  simulate  the  transformation 
which  maps  events  onto  categories. 

As  an  example  of  classification  and  to  illustrate  a peculiar  feature  of 
"category"  consider  a set  of  objects  which  include  a screwdriver,  hammer, 
saw,  drill,  etc.  These  objects  are  identified  as  tools.  However,  note 
that  one  cannot  display  a tool  which  is  not  also  either  a saw,  hammer, 
screwdriver,  or  one  of  the  objects  that  is  usually  denoted  by  the  category 
of  tools.  Thus,  one  can  say  that  a tool  is  an  abstract  concept  and  that 
no  physical  signal  can  be  displayed  which  means  a tool  and  only  tool. 

That  is,  a category  is  only  implicitly  defined.  One  may  further  note  that 
categories  may  be  reported  using  symbols  which  again  are  not  categories, 
but  representations  of  the  categories  and  as  such  are  not  intrinsically 
different  from  the  objects  identified  as  members  of  the  category. 

3.  Theoretical  Developments 

The  primary  direction  of  Nortronics  research  into  self-organizing  systems 
has  been  the  development  of  a general  description  of  the  functional  behavior 
of  self-organization,  using  the  tools  of  information  theory. 

The  definition:  "A  machine  is  said  to  be  self-organizing  if.  after 
observing  the  input  and  output  of  an  unknown  phenomenon  (transfer  relation), 
the  machine  organizes  itself  into  a simulation  of  the  unknown  phenomenon." 
was  adopted  to  specify  the  behavior  required. 
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For  example,  suppose  f(x)  Is  the  transfer  relation  which  describes  the 
relation  between  the  inputs  of  an  automobile  (steering,  brakes,  throttle) 
and  the  resultant  trajectory  (output).  Suppose  furthermore,  that  there 
existed  a device  which  for  a given  desired  trajectory  could  provide  inputs 
to  the  automobile  such  that  the  automobile  realized  the  desired  trajectory. 
Then  an  observer  would  deduce  that  such  a device  possessed  a simulation 
of  f-1(x) . If  in  addition,  said  device  acquired  f“^(x)  solely  be  observing 
the  input -output  history  which  implicitly  defines  f(x),  said  device  is  called 
a self-organizing  machine.  Features  of  such  a machine  include: 


1.  It  operates  on  raw  data  and  does  not  require  initial  assignment 
of  the  significant  properties  of  raw  data. 

2.  It  examines  detail,  but  would  report  only  significance. 


3.  It  would  classify  and  compare . 

4.  It  would  adapt  to  changes  in  the  relation  it  is  to  simulate. 


5.  Such  a machine  would  possess  a standard  mechanism;  i.e.,  one 
mechanism  would  be  capable  of  simulating  a variety  of  transfer 
relations  whether  they  represent  classification  of  radar  signals, 
sonar  signals,  seismic  data,  etc. 


A summary  of  the  theoretical  work  on  these  problems  to  date  was  presented 
in  two  parts  (1,2)  at  the  First  Pasadena  Invitational  Symposium  on  Self- 
Organizing  Systems,  sponsored  by  the  Office  of  Naval  Research  in  November 
1963. 

4.  The  SOMA 

A recent  outgrowth  of  Nortronics'  research  in  self -organizing  systems  is 
a device  which  decorrelates  correlated  random  inputs  in  a suprisingly  simple 
manner.  This  device,  which  we  call  the  Self -Organizing  Machine  Artifact 
(SOMA),  has  been  mechanized  to  process  audio  frequency  signals  using  a 
circuit  built  from  only  a handful  of  transistors.  This  makes  practical 
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the  construction  of  many-e lenient  SOMA  networks  whose  capabilities  we  are 
only  now  exploring.  One  obvious  application  for  such  a network,  the 
resolution  of  a complex  signal  into  its  independent  components,  opens 
interesting  avenues  of  research  into  pattern  recognition,  as  well  as 
offering  possibilities  for  advances  in  the  more  conventional  areas  of 
automatic  data  processing. 


Basically,  the  SOMA  is  a device  which  drives  the  correlation  of  its  two 
input  signals  to  zero  by  rotating  the  original  signals  through  an  angle  8 
to  obtain  two  new  linear  combinations  of  the  inputs: 


yx  - xx  cos  { + x2  sin  g 


y2  sin  6 + x2  cos  j 


After  a brief  exposure  to  the  input  signals  x^  and  the  SOMA  learns 
the  value  of  & which  makes  y.  and  y_  uncorrelated.  For  Gaussian  ran 


random 


inputs  this  rotation  makes  y^  and  y2  correspond  to  the  major  and  minor 
axes  of  the  ellipses  of  constant  probability  density. 


Immediate  Program  Goals 


Demonstration  of  an  Elementary  Classification  Task  (FY  65) 


The  immediate  objective  is  to  demonstrate  that  a network  of  self- 
organizing  machine  elements  can  perform  an  elementary  classification 
task.  Because  the  supply  of  elements  are  limited,  this  initial  demon- 
stration will  require  configuring  the  task  to  the  machine.  Additional 
technological  refinement  of  the  SOMA,  theoretical  development  which 
provides  the  synthesis  for  networks  of  SOMA's  and  construction  of  a 
network  of  SOMA's  are  required  to  reach  this  objective. 


Demonstration  of  a Specific  Classification  Task 


A group  of  SOMA's  will  be  configured  to  perform  a specific  classification 
task.  By  specific  is  meant  a task  from  which  extrapolation  to  an 
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operationally  significant  task  is  relatively  straightforward.  Further- 
more, it  is  the  intent  to  synthesize  a SOMA  network  to  an  a priori 
selected  (but  no  doubt  still  somewhat  primitive)  task. 
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